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EVOLVING SYSTEMS: 

NONLINEAR ADAPTIVE KEY COMPONENT CONTROL 
WITH PERSISTENT DISTURBANCE REJECTION 

Mark J. Balas and Susan A. Frost^ 

This paper presents an introduction to Evolving Systems, which are autono- 
mously controlled subsystems that self-assemble into a new Evolved System 
with a higher purpose. Evolving Systems of aerospace structures often require 
additional control when assembling to maintain stability during the entire evo- 
lution process. This is the concept of Adaptive Key Component Control which 
operates through one specific component to maintain stability during the evolu- 
tion. In addition this control must overcome persistent disturbances that occur 
while the evolution is in progress. We present theoretical results for the suc- 
cessful operation of Nonlinear Adaptive Key Component control in the pres- 
ence of such disturbances and an illustrative example. 


INTRODUCTION 

Evolving Systems are autonomously controlled subsystems which self-assemble into a new 
Evolved System with a higher purpose 1 ' 2 . Evolving Systems of aerospace structures often require 
additional control when assembling to maintain stability during the entire evolution process 3 " 5 . An 
adaptive key component controller has been shown to restore stability in Evolving Systems that 
would otherwise lose stability during evolution* 1 . The adaptive key component controller uses a 
direct adaptation control law to restore stability to the Evolving System through a subset of the 
input and output ports on one key component of the Evolving System. Much of the detail of 
Evolving Systems appears in the chapter (ref. 8). In this paper, we will deal with the situation 
where persistent disturbances can appear in some components and must be mitigated by the adap- 
tive key component controller. Such disturbances will often be attendant in actively controlled 
rendezvous and docking. 

The control laws used by the adaptive key component controller to restore stability in an 
Evolving System are guaranteed to have bounded gains and asymptotic tracking if the Evolved 
System is almost strictly dissipative. Hence, it is desirable to know when the dissipativity traits of 
the subsystem components, including the key component, are inherited in an Evolving System. 
We present results describing when an Evolving System will inherit the almost strict dissipativity 
traits of its subsystem components. Then we will present an adaptive key component controller 
that restores asymptotic stability with bounded adaptive gains and mitigates the effect of persis- 
tent disturbances during evolution. 
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MATHEMATICAL FORMULATION OF EVOLVING SYSTEMS 


A mathematical formulation of a nonlinear time-invariant Evolving System is given here. 
Consider a system of L components of individually, actively controlled subsystems which can be 
described by the following equations for the z' th component: 

ji, =/:(x,,M,) 


where i = 1, 2,...L . The z th component has a performance cost function .7, and a Lyapunov func- 
tion These are the building blocks of the Evolving System. When these individual components 
are joined to form an Evolved System, the new entity becomes: 


(x = f(x,u) 
\y = g{x,u ) 


( 2 ) 


with x = [XyX^ , V = [Ti--Ti] r > performance cost function J, and Lyapunov function V. The 
/ th component in the above Evolved System is given by: 

x i =f i (x i ,u i ) + Y J £ i jfi J ix i ,Xj, u j ); 0 < £•„ < 1 (3) 

/-i 

where (x j , x . f , u. ) represents the interconnections between the i and / h components. Note that 

when £y = 0, the system is in component form and when <£v = 1, the components are connected 
and the system is fully evolved. As the system evolves, or joins together, the ’s continuously 
change from 0 to 1 . 

The components of the Evolving System are actively controlled by means of local control. Lo- 
cal control means dependence only on local state or local output information of the component, 
i.e., u j = h t (x.) or u j = h t (y . ) . In general, the local controller on the z th component would have 
the form: 

[i. =/,(T„z) 


where z ( is the dynamical part of the control law. Local control will be used to keep the compo- 
nents stable and meet the individual component performance requirements, J, . 

Once the system is fully evolved (i.e., = 1 ), the i th component becomes: 

L 

x, = f, O, » «/ ) + Z fa ( x i ’ x j > u j ) ( 5 ) 

7=1 
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A state space version of the z' ,h individual component of an Evolving System where the com- 
ponents are connected through the states can be represented as: 

L 


*/ = A ( x i ) + B , ( x t K + Z £ u a v ( x i ’ x j)’ x i (°) = \ 

" j = i 


( 6 ) 


y t = c X x i) 

where i = \,2,...L , x t = [xj . . . x' n ] T is the component state vector, u j = \u\ . . . u‘ m ] T is the con- 
trol input vector, y t = [y\ . . . y p ] ' is the sensor output vector, ( /f (x i ), B t (x i ), C (x i )) are vector 
fields of dimension n j x n t , n j x nr , and p t x n j , respectively, and the connection forces be- 
tween components are represented in the n i xn j connection matrix, A ij (x i ,x J ) with £ jj =£ ir 
The state space representation of the Evolved System then becomes: 


jx = A(x) + B(x)u 
1 y = c(x) 


which can also be written as ( A(x),B(x),C(x )) . 


INHERITANCE OF SUBSYSTEM TRAITS IN EVOLVING SYSTEMS 

We say a subsystem trait, such as stability, is inherited when the Evolved System retains the 
characteristic of the trait from the subsystem. Previous papers have examined the inheritance of 
stability and shown that stability is not a generally inherited trait’" 5 . Inheritance of almost strict 
passivity of subsystems is desirable in Evolving Systems that use an adaptive key component 
controller to restore stability. 

In previous papers 5 ' 6 , a key component controller has been proposed to restore stability to 
Evolving Systems which would otherwise lose stability during evolution. The design approach 
used by the key component controller is for the control and sensing of the components to remain 
local and unaltered except in the case of one key component which has additional local control 
added to stabilize the system during evolution. The key component controller operates solely 
through a single set of input-output ports on the key component, see Fig. 1. 




Figure 1. Key component controller. 
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Only the key component of the Evolving System needs modification to restore the inheritance 
of stability. A clear advantage of the key component design is that components can be reused in 
many different configurations of Evolving Systems without the need for component redesign. The 
reuse of components which are space-qualified, or at least previously designed and unit tested, 
could reduce the overall system development and testing time and should result in a higher qual- 
ity system with potentially significant cost savings and risk mitigation. 

In many aerospace environments and applications, the parameters of a system are poorly 
known and difficult to obtain. Adaptive key component controllers, which make use of a direct 
adaptation control law, are a good design choice for restoring stability in Evolving Systems where 
access to precisely known parametric values is limited. The sufficient condition for an Evolving 
System with an adaptive key component controller to be guaranteed to have bounded gains and to 
have asymptotic output tracking is that the system be almost strictly dissipative. So, we are inter- 
ested in the conditions under which the inheritance of almost strict dissipativity can be guaranteed 
in Evolving Systems. 

INHERITANCE OF ALMOST STRICT DISSIPATIVITY IN EVOLVING SYSTEMS 

Inheritance of almost strict dissipativity of subsystems is desirable in Evolving Systems that 
use an adaptive key component controller to restore stability. Consider a nonlinear system of the 
form given by Eq. (7). We say this system is Strictly Dissipative when there exists a function 
V(x) > OVx ^ 0 such that the Lie derivatives satisfy: 

| L a V = V VA(x) < -S (x) Vx 

{L b V = V VB(x) = C T (x);VV = gradient V 

The function V (x(t)) is called the Storage Function for Eq. (7), and the above says that the stor- 
age rate is always less than the external power. This can be seen from 

V = VV[A(x) + B(x)u] 

< -S ( jc ) + C T (x)u (9) 

= -S(x) + (y,u) 

Taking u = 0, it is easy to see that Eq. (9) implies Eq. (8a) but not necessarily Eq. (8b); so Eq. (8) 
implies Eq. (9) but not conversely. They are only equivalent if Eq. (8a) is an equality. (When 
equality holds in Eq. (8) and Eq. (9), the property is known as Strict Passivity.) 

We will say a system (u,y) is Almost Strictly Dissipative (ASD) when there is some output 
feedback, u = G,y + u r , so that the following is strictly dissipative: 

jx = A c (x) + B(x)u r ;A c (x) = A(x) + B(x)G,C(x) 

I y = C(x) 

Now if each component of an Evolving System is ASD, then we have 
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VFtf4(*i) + B i (x i )G i C i (x i )] < -Sfa) + 'Ze v VV i A v (x J ,u J ) 

M 

VV l B,(x l ) = C?(x i ) 


( 11 ) 


where V V i = gradientV i . Due to the interconnection terms, Eq. (11) is not necessarily strictly 

dissipative. However, in some circumstances, the interconnection terms have a special form and 
ASD is inherited when the system evolves. 

Suppose we have a pair of subsystems of the Form : 

*, = 4 (A ) + eB t (*>, + B f (A 

<y. = C i (x i ) (12) 

X=Cf{x t ) 


where i = 1 , 2 and both subsystems 

Ml 

A 

V, 

A 

N 

and 

u 2 

A 

y 2 

A 

\ 

have storage functions 


u x 

L- V i J 

/ 

u 2 

\_y 2 J 

/ 


V t . We have the following result: 


Theorem 1 : If the subsystems (wj 4 , yj 1 ) and (u 2 , ) are ASD and 

V^ ; .(x i ) = Cf(x i );/ = l,2 (13) 


then the resulting feedback connection, yj = w, and Uj = —y 2 , will leave the composite system 
almost strictly dissipative. 
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y t 
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U 2 




Proof: See Appendix. 

It was previously shown that the physical connection of components is equivalent to the feed- 
back connection of the admittance of one to the impedance of the other 3 " 4 . When two components 
join to form an Evolved System, at their point of contact, their velocities are equal and the forces 
exerted are equal and opposite. If the two components are given by (/j,v,) and (/ 2 , v’ 2 ) . then 
the contact dynamics of the Evolved System can be represented by: 


f=~f 2 

v,=q l =v 2 ^ q 2 


(14) 


This connection can be modeled as the admittance of one component connected in feedback 
with the impedance of the other component. When we use this idea of the joining of two compo- 
nents of an Evolving System as the feedback connection of their admittance and impedance, we 
can apply Theo. 1 from above to determine whether almost strict dissipativity is inherited by the 
Evolved System. Consequently, if the two subsystems (m 1 ,}' 1 ) and ( u 2 ,y 2 ) are in admit- 
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tance/ impedance form, then Theo. 1 shows that ASD is an inherited property for nonlinear Evolv- 
ing Systems. 

MATHEMATICAL FORMULATION OF ADAPTIVE KEY COMPONENT 
CONTROLLER WITH PERSISTENT DISTURBANCE MITIGATION 

In this section, we describe the mathematical formulation of an adaptive key component con- 
troller for restoring stability to an evolving system. The key component is chosen to be compo- 
nent #1 of the evolving system and will be modeled by the following nonlinear system with an 
external persistent disturbance: 

\ =A i (x^)+sB l (x x )U\ +Bf(x l )u f +T x (x l )u D 

• Ti =QC*i) (15) 

yf =c i( x i) 

All vector fields in Eq. (15) will have the appropriate compatible dimensions and be smooth in 
their arguments with a single equilibrium point at 0 in a neighborhood U. 

The persistent disturbance input vector u D (?) is ND-dimensional and will be thought to 
come from the following disturbance generator: 

\z D = F z D ,z D (0) = z 0 

where the disturbance state z D (?) is ND-dimensional. Such descriptions of persistent distur- 
bances were first used to describe signals of known form but unknown amplitude 9 . For example, 
step disturbances yield 0 = 1 and F=0 while sinusoidal disturbances can be described by 


0 

= [i o] 

F = 

0 1 

-co 2 d 0 


where the frequency co D is known but the amplitudes are unknown. 

Assume that the disturbance generator parameter F is known. In many cases this is not a se- 
vere restriction as when the disturbance has the form of a sinusoidal or a step function. To im- 
prove understanding, the above can be written in the following equivalent form: 

\u n = 0z n 

\ r (16) 

[ Z D ~ L(P D 

where (p D is a vector composed of the known basis functions for the solutions of z D (?) and 
( L , 0) need not be known. The solution of z D (?) can be written as: 
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™ D 

z D (t) = e F ‘z n (0) = [«p, (0, (p 2 it), ...,(p No {t)\z D { 0) = £ z>« (?) =L<p D 

i = 1 


Note that L is directly related to F via its columns but not to 0 . Some rearrangement of the 
entries in the columns of F is needed to create (p D . A simple example of the above is given by 
the following: 


x = 


< 


"0 f 


" 0 " 


T 


x + 


U + 


0 °_ 


1 


l 


u D = asm(co D t + b) = a l sin {co D t) + a 2 cos (a> D t) 


(17) 


Assume 


VI j 

VL u t 


y, 


is ASD. Also assume the following matching condition is true: 


Rir^cRiB^xJ) 


(18) 


which says there exists //, such that S, ' (x, )/7* = r, (x, ) . 

Component #2 will represent the rest of the evolving system and will be assumed to be strictly 
dissipative by choice of local controllers: 

Jx 2 = A 2 (x 2 ) + £B 2 {x 2 )u 2 (19) 

[.^2 = C 2 ( Xt ) 


The components are in admittance-impedance fonn so when they are joined u l = —y 2 and 
u 2 = V[ . The adaptive key component controller with disturbance mitigation works through the 
control input-output ports (uf,y l ) of component #1 and is defined by: 

uf = G e yf + GJ D 

'G e =-yf(yf) T y e ;y e > 0 (20) 

g d =-y\{<t> D j r y D ',yD >° 


>0 with bounded adaptive gains ( G e , G j} ) as the following con- 


This produces x = 
vergence theorem shows: 

Theorem 2: Assume that fj and V 2 are positive for any x ^ 0 and radially unbounded, and 
(A(x),B(x),C(x)) are continuous functions of x and S(x ) , above, is positive for any x^O 
and has continuous partial derivatives in x. Furthermore, assume: 
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1) The conditions of Theo.l are satisfied; so that 


is almost strictly dissi- 


2 ) 

3) 


u \ 

uf 

pative (ASD) 

The matching condition: T , (x, )) cz R( B l i (x l )) 


y, 


(j) D is bounded (or F has only simple imaginary poles and no right half-plane poles) 


>0 


Then the adaptive key component controller given by Eq. (20) produces x = 
with bounded adaptive gains ( G e ,G D ) when component 1 is joined with component 2 into an 


Evolved System and the outputs y i = C (x i ) - 


t-> CO 


-> 0 . 


Proof: See Appendix. 

It should be noted that the above results might only hold on a neighborhood 
iV ; (0, r.) = / UjcJ < r\ . Then the stability in Theo. 2 is only locally asymptotic to the origin. 


ILLUSTRATIVE EXAMPLE 

Example 1, which follows, is a two component linear flexible structure Evolving System. The 
components of Ex. 1 are stable when they are unconnected components, but the Evolving System 
fails to inherit the stability of the components. This example will be used to demonstrate the in- 
heritance and lack of inheritance of almost strict dissipativity in Evolving Systems. 


Component 1 Component 2 



Figure 2. Example 1: A two component flexible structure Evolving System. 


The dynamical equations for the components of Ex. 1 are: 


K<7i =Mj ~£ u k n (q ] -q 2 ) 
component 1: < T 


(21a) 
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(21b) 


component 2: 


Tn^iji u 2 £ l 2 k n (cj 2 Q \ ) ^22(^2 *? 3 ) 

m 3 q 3 =u 3 -k ] 2 (q 3 -q 2 ) 

y 2 = [q 2 ,q 2 ] J 

v 3 = [^3,^] T 


with m l =30, m 2 =1, m 2 = 1 , k vl = 4 . and k 21 = 1 . Example 1 has controllers: 

w, = -(0.95 + 0.l)<7, 

2 =-[— + 0 . 2 s + O.5V 

V 5 J 

u 3 = -(0.65 + \)q 2 


( 22 ) 


The subsystem components from Ex. 1 are stable in closed-loop form when they are uncon- 
nected, i.e., £ n = 0 . When £ n =1, the system is fully evolved and it has a closed-loop eigen- 
value at 0.17, resulting in an unstable Evolved System. 

A Simulink model was created to implement an adaptive key component controller for Exam- 
ple 1 as described in the previous section. Simulations were run in which the connection parame- 
ter, £ l2 , ranged from 0 to 1, allowing the system to go from unconnected components to a Hilly 
Evolved System. The key component controller was able to maintain system stability during the 
entire evolution process when it used the input-output ports on mass 1 of component 1, see Fig. 3. 
When component 1 was the key component, the fully evolved system is almost strict positive real 
(ASPR), which is equivalent to almost strictly dissipativity for LTI systems 11 . 


Mass Displacement with Adaptive Control on Mass 1 



Figure 3. Adaptive key component controller on mass 1. 

When the key component controller was located on component 2 and used the input-output 
ports on mass 3, stability was not maintained, see Fig. 4. The adaptive key component controller 
was not able to restore stability on mass 3 because that system was not ASPR, i.e., it had non- 
minimum phase zeros at 0.005 15±0.2009i. Hence it did not satisfy the almost strictly dissipative 
condition of Theo. 2. 
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Time (seconds) 

Figure 4. Adaptive key component controller on mass 3. 


CONCLUSION 

We have presented a result (Theo. 1) describing when an Evolving System will inherit the al- 
most strict dissipativity traits of its subsystem components. An example was given of successful 
inheritance of almost strict dissipativity and failed inheritance of almost strict dissipativity. This 
result allows a control system designer to detennine a sufficient condition for an Evolving System 
to use an adaptive key component controller to restore stability. We also presented a convergence 
result (Theo. 2) for an adaptive key component controller to restore stability during evolution and 
mitigate persistent disturbances. 
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APPENDIX 
Proof of Theorem 1: 

Let {uf ,yf ) be ASD. From (9) and (11), there exists G i such that 


V^4 c (x ; ) = W i ^A i (x i ) + Bf(x i )G*Cf(x i )~\ 
VV i Bf(x i ) = Cf(xf 


- ~Si ( X i ) + V VfAy (x ; , «1 , uf ) 


(Al) 


If we connect {u x ,yf) in feedback with {u 2 ,y 2 ), then y x = u 2 and Uj = -y 2 and, use (12) 
and (13), then we have VV l A l2 (x l ,u l ,uf ) = VV l B l (x l )u l = Cf (x,)[-y 2 ] = ~y\y 2 and similarly, 
V V 2 A 2 1 ( x 2 ,u 2 ,u 2 ) y 2 Vj • 


Let x 


and. from Eq. (12), 


x = A{x) + B{x)u = 


4 (-*) ) + ‘£'| 2 2 (-*2 ) 


"^(X,) o 

uf 

_ A 2 (X 2 ) + £ 2I A 2i (X| 


0 B 2 (x 2 )_ 

uf 


y- 


Vi 

yf 


C(x)- 


Cf(x x ) 
C 2 (x 2 ) 


with V = V t +V 2 , using Eq. (13) and £ ji = s tj = £ from Eq. (3), 
VVA(x) = [VV 1 VV 2 ] 


V 

(-*i ) L ^^12 (-^2 ) 

A 2 (x 2 ) + £A 2i (x x ) 

= VV l A 1 (x, ) + s(-yl y 2 j + VV 2 A 2 (x 2 ) + £ ( y[ y , ) 

<-[S x (x,) + S 2 {x 2 )\ + £[-y T ,y 2 ) + £{y T 2 y,) 

= -S(x) 


and 


VVB(x) = [W l VV 2 ] 


Bf(x x ) 0 


'cf( X y 

0 Bf(x 2 ) 


Cf(x 2 )_ 


Therefore 

f 

u A = 

uf 

A 

>y.4 = 

r a~ l^ 


V 

U 2 


L^JJ 


is 


ASD 


= C r (x) 


with output 


uf 


'g; 

0 " 

1 

^ — 

1 

+ 

„ Ar 

u l 

uf 


0 

g\ _ 

_y 2 . 


„ Ar 

u 2 


as desired. End of proof. 


(A.2) 


feedback 


205 


Proof of Theorem 2: 

Since the physical connection of component 1 to component 2 is equivalent to the feedback 
connection u x = —y 2 and u 2 = y 2 , 

By Theo.l we have that the closed-loop system (uf ,yf) below is ASD: 

x, = A, (x, ) - sB, (x, )C 2 (x 2 ) + Bf (x, 

< x, = /1 2 (x 2 ) + sB 2 (x 2 ) C, (x, ); 0 < s < 1 (A3) 

X = C "(x 1 ) 

Rewrite Eq. (20) to obtain, 


u \ = ( A>'| 4 + G D cp D = G’ e yf + G* D (p D + AGr/ 


AG = G-G* = [ AG C AG d ];?7 = 


v, 

(Pd 


a G = G = -y?(y?) T r,r = 


r e o 

0 Yd 


>0 


(A4) 


Combining (A. 3) and (A.4) yields: 

Xi = A x (xj -£ , J S 1 (x 1 )C 2 (x 2 ) + [s i ' 4 (x 1 )Gfl +r i (x 1 )0Z,]p o + B?(x 1 )w 
< x 2 = A 2 (x 2 ) + sB 1 (x 2 )C l (x l ); 0 < s < 1 
yf = cf(x l ) 


(A5) 


with w=AGrj and G* D = —H,OL ffomEq. (20) and A x (x l ) = A j (x l ) + Bf(x i )G*Cf(x i ). 


Let V = V t +V 2 and we have: 

V = -S(x) + (yf,w) 

Now form V G = —tr(AGy~ l AG T ) and obtain from Eq. (A. 3): 

V G = tr(AG 7 'AG T ) = -tr(yf(yf) T AG T ) = -tr(yf(w) T ) 

= -{yf>w) 


(A6) 


(A7) 
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Define: V (x, AG) = V(x) + V G (AG) and, from Eq. (A. 5) and Eq. (A7), we have: 


V(x, AG) = V(x) + V G (AG) = -S(x) + (yf , w) - (yf , w 
= -S(x) < 0 


(A8) 


This guarantees that all trajectories (x, AG) are bounded. If V(x, AG) is uniformly continuous 
or V (x, AG) is bounded, then Barbalat’s Lemma 10 yields: 

S ( x )-^0 

and the positivity and continuity of S(x) imply that x = 

dS(x) 


-> 0 . Now consider 


V(x, AG) = -S(x) < |S(x)| = 
. dS(x) 


dS(x) . 


dx 


dx 


be < 


dS(x) 


dx 


[||^4(x)|| + ||5(x)||||w 1 ' < ||] 


dx 


[||^(x)|| + ||5(x)||||AG||||C 1 i< (x 1 )||] 


which is bounded because (x,AG) is bounded, S(x) has continuous partial derivatives and 
( /l(x), B(x), C(x)) are continuous, and a continuous function of bounded x(t) is also bounded 
in t. So, y t = C, (x ; ) — — — >0 because C, (x ; ) is continuous. End of proof. 
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